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■ A generic algorithm is developed to reduce the problem of obtaining linear and nonlin- 

■"xf ; 

■ ear entanglement witnesses of a given quantum system, to convex optimization problem. 
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of any N-partite quantum system. For this purpose, a map from convex space of separa- 
ble density matrices to a convex region called feasible region is defined, where by using 
exact convex optimization method, the linear entanglement witnesses can be obtained 
from polygonal shape feasible regions, while for curved shape feasible regions, envelope of 
the family of linear entanglement witnesses can be considered as nonlinear entanglement 
witnesses. This method proposes a new methodological framework within which most of 
previous EWs can be studied. To conclude and in order to demonstrate the capability 
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of the proposed approach, besides providing some nonlinear witnesses for entanglement 
detection of density matrices in unextendible product bases, W-states, and GHZ with 
W-states, some further examples of three qubits systems and their classification and en- 
tanglement detection are included. Also it is explained how one can manipulate most of 
the non-decomposable linear and nonlinear three qubits entanglement witnesses appear- 
ing in some of the papers published by us and other authors, by the method proposed in 
this paper. 

Keywords: non-linear and linear entanglement witnesses, convex optimization 
PACS number (s): 03.67.Mn, 03.65.Ud 

1 Introduction 

Entanglement is one of the interesting features of quantum systems. It is used as a physical 
resource in realization of many quantum information and quantum computation processes 
such as quantum parallelism [I], quantum cryptography |2], quantum teleportation [3[ H], 
quantum dense coding [5J E] , reduction of communication complexity [7] and beating classical 
communication complexity bounds with entanglement [8j. In these applications usually a 
source produces entangled particles and after these particles reach to the related parties, there 
is an important question for the parties - are these particles already entangled? 

One approach to distinguish entangled states from separable ones is entanglement witness 
(EW) [HI [9]. A quantum state is entangled iff there exists a Hermitian operator W with 
Tr(Wp) < and Tr(W p sep ) ^ for any separable state p sep pU]. We say that the witness W 
detects the entanglement of density matrix. Recently there has been an increased interest in 
the nonlinear EWs because of their improved detection with respect to linear EWs. A nonlinear 
EW is any bound on nonlinear function of observables which is satisfied by separable states 
but violated by some entangled states [SJ HH [121 13] • 
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Optimization problems occur in both classical and quantum physics [14J. One of the im- 
portant subclass of optimization is convex optimization where the related functions of problem 
are convex. The importance of convex optimization is that in these optimizations, any locally 
optimal solution of problem is guaranteed globally optimal [T5]. On the other hand, the set 
of all possible states of a quantum system that can occur in nature must be a convex set (16] 
and as the state of a quantum system is fully characterized by density matrix of that system 
so the density matrix must be a convex function. Therefore, convex optimization is a natural 
optimization in quantum information. 

Although all the work on this paper deals with obtaining EWs via convex optimization, 
other optimization approaches such as linear and semi-definite programming methods, can be 
found in the literature. For example, the reader can find obtaining some EWs by linear pro- 
gramming in [I8l [T9| [20]. semi-definite programming for distinguish entangled from separable 
quantum states and using robust semi-definite programs and EWs to study the distillability 
of the Werner states in [2T1 122] , and convex optimization applications in entanglement in [23] . 

In this paper, we provide a general algorithm for finding the EWs by exact convex opti- 
mization method. For this purpose, for a given system or density matrix we determine the 
feasible region (FR). The FR for a system is defined by the mapping from separable states 
space to a region called feasible region i.e. Tr{W p s ) where p s is separable density matrices of 
that system. As the p s has convex structure, FR must be convex too ( the defined mapping 
do not change the convexity property ). Any tangent to the surface of this FR corresponds to 
an EW because it separates at least an entangled state from separable states. If this FR was 
a polygon, applying first convex optimization to this convex function, would give linear EWs 
which are one of vertices of polygon but if the FR was not a polygon, then applying convex 
optimization would give a family of linear EWs which are tangent to FR. Nonlinear EW could 
be considered as the envelope of these family [25] . The key point for convex optimization 
arise from the linear or nonlinear form of FRs therefore linear or nonlinear cost functions and 
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constraints in convex optimization problem. Although we will not consider in this paper, if 
one can not determine the FR exactly, one can solve the problem by approximating the FR ( 
for example one can encircle the FR with a polygon [18]). Also, if one can not solve the convex 
optimization problem analytically, there are efficient numerical methods such as interior point 
method which may solve the problem numerically After then we consider the entanglement de- 
tection problem of given density matrix with EWs in the previous part. The optimized EW(s) 
is come from the reapplication of convex optimization with new constraints. Although this 
method is general and could be applied for any quantum systems, here we present examples 
with some new EWs for three qubits systems. 

The structure of the article is as follows. Sec. II introduces FR for a given system and 
discusses how to determine FR for some selected operators in the Hilbert space of that system. 
In Sec. Ill convex optimization is applied for finding linear EWs using FR which is determined 
in second section. In Sec. IV convex optimization is applied again for finding nonlinear EWs 
using results of Sec. III. In Sec. V, we list some important linear and nonlinear EWs for three 
qubits systems which have been detected by convex optimization. The non-decomposability 
of these EWs are also discussed. Optimality of some EWs including linear EWs and a special 
case of spherical case is presented in Sec. VI. The detection of these EWs for some important 
three-qubits density matrices such as density matrices in unextendible product bases, W- 
state, and mixed GHZ with W states density matrices, have been presented in Sec. VII. 
Convex optimization review and some detailed proofs of paper would presented in appendices. 
Throughout these section, we have presented examples with details for three qubits system to 
present the practicality of this method. 
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2 Feasible region 



One of the main problems in quantum information processing is detecting the entanglement of 
the system. For a given state of a quantum system i.e. density matrix, we want to find some 
(particularly optimal) EW's for detecting entanglement of the system. 

Consider a multipartite quantum system consisting of n subsystems which is characterized 
by density matrix. In real applications of quantum information density matrices are mixed. 
A mixed state of n systems is entangled if it cannot be written as a convex combination of 
product states [8] p ^ 5^. £>«Pi <8> ••• ® p l n with Pi ^ and J^Pi = 1j otherwise it is separable. 
The total Hilbert space H of n systems is a tensor product of the subsystem spaces H = ® n ._ i H i 
and any Hermitian operator such as EW could be written as a combination of operators Qi in 
this total Hilbert space. 

Now consider a set of Hermitian operators Q i . This set of operators are chosen in a way 
that the entanglement of the system could be detected. We will attempt to construct various 
linear and non-linear EWs using these operators. To this aim, for any separable state p s we 
introduce the maps 



which map the convex set of separable states into a convex region named the feasible region 
(FR). Any hyper-plane tangent to the FR corresponds to a linear EW, since such hyper-planes 
separate the FR from entangled states. Hence, we need to determine the geometrical shape of 
FR. In general, determining the geometrical shape of FR is a difficult task. However, one may 
choose the Hermitian operators Q i in such a way that the exact geometrical shape of FR can 
be obtained rather simply. By such a choice, when the FR is a polygon, its surface corresponds 
to linear EWs which are linear combinations of the operators Q i ; otherwise, linear EWs come 
from any hyper-plane tangent to the surface of FR. When the FR is not a polygon, there are 
a family of linear EWs which any of them are tangent to FR and the envelope of this family 



P t = Tr(Q iPs ) 



(2.1) 
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could be considered as nonlinear EW. [13j 02] • 

In summary, there are two kinds of inequalities which determines the FR, nonlinear and 
linear ( see example 2 ). Therefore, the FR are constructed with some hyper-surfaces coming 
from nonlinear inequality constraints and some hyper-planes coming from linear inequality 
constraints. As any hyper surface tangent to FR is an EW, the envelope of linear EWs family 
each tangent to the nonlinear part of FR could be considered as nonlinear EWs. Finally, 
linear inequalities lead to linear EWs which are tangent to linear surfaces of FR. 

In analyzing the FR, there are three cases for region defined by nonlinear and linear in- 
equality constraints. In first case, the region defined only by linear inequality constraints, i.e. 
gi(P\, .., P n )i he completely outside the region defined only by nonlinear inequality constraint, 
i.e. /(Pi, .., P n )- In this case, the nonlinear constraints define the FR completely. In the second 
case, the region defined only by linear inequality constraints lie completely inside the region 
defined by only nonlinear inequality constraint. In this case, the linear constraints define the 
FR completely. And finally in the third case, the nonlinear and linear inequality constraints 
have some inter sections and due to nature of convex optimization, the optimal point in the 
FR is one of these intersection or lie in the intersections of linear constraints ( see following 
examples ). 

Example 1: FR with polygonal shape for three qubits systems 

As a special case we try to find FR with polygonal shape for a three qubits system. The 
operators in this Hilbert space could be written as tensor product of Pauli group operators for 
qubit i.e. 

(Ti ® o-j <g) a k , i, j, k — 0, 1, 2, 3. (2.2) 

where cro? 0i, &2 and 03 stand for the two dimensional identity operator I2 and single qubit 
Pauli operators a x , a y and a z respectively. For simplicity hereafter we will use the notation 
I2 = I, a x = X, a y = Y, and a z = Z and will skip over the tensor product notation. The 
general task is to find linear and nonlinear relations between operators in the Hilbert space of 
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three-qubits. As there are many ways for choosing set of operators and then finding relation 
between them, we may restrict ourselves to operators which appear in the expansion of given 
density matrix of system in terms of Pauli operators. As an example consider the following 
set of operators. 

Q 1= XXX, Q 2 = XYY, Q 3 = YXZ, Q A = YZY, Q 5 = ZYZ, Q 6 = ZZX. (2.3) 
The linear constraints are (see appendix B) 

(-If P X + (-lfP 2 + (-If P 3 + (~lf P 4 + (-If P 5 + (_lf + ^3 + * 4+ * 5 + lp6 ^ 1 {2A) 

and the FR is a polygon which its boundary planes are (12.41) . 

Example 2: FR with quadratic and polygonal shape for three qubits systems 

This is an example that there are nonlinear constraints in addition to linear ones for FR. 
If we choose the following set of operators 

Q 1 = ZXX + ZYY, Q 2 = XXX + XYY, Q 3 = YXX + YYY, 

Q 4 = ZXY + ZYY, Q 5 = XXY + XYX, Q e = YXY + YYX, (2.5) 

Q 7 = IXZ, Q 8 = IYZ, Q 9 = IZI, (2.6) 

some trigonometric calculations (see Appendix B) lead to the following FR 

9 

which is a hyper ball in P«s space. In addition to this nonlinear hyper-surfaces, i.e. (12. 7p . there 
are some linear hyper-planes which restrict the FR. These are 

±Pl±P 5 ^l, ±P!±P 6 ^1, 
±P 2 ±P 4 <1, ±P 2 ±P 6 ^1, 

± P 3 ± P 4 < 1, ±P 3 ± P 5 < 1. (2.8) 

As in geometry, a spherical cap is a portion of a sphere cut off by a plane so one can say that 
the FR is a hyper-ball cap but now cut off by 24 planes in (12.81) . 
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3 Constructing linear EWs via convex optimization 

After determining the FR which is a convex region, we can convert the problem of finding EWs 
to the convex optimization problem. Now we can construct EWs from operators Qi which have 
been used before for obtaining the FR. For this purpose consider a Hermitian operator W with 
some negative eigenvalues 

W = A I + J2 A iQi (3-9) 

i 

where Aq is nonzero positive real, I is identity matrix with dimensionality equal with the 
Hilbert space of the system, Qi are positive operators with — 1 ^ Tr{Qip s ) ^ 1, for every 
separable states p s , and A; are real parameters whose ranges must be determined in a way 
that W become an EW. 

From definition of EW the condition, Tr(Wp s ) ^ 0, must be satisfied. In order to satisfy 
this condition, we use convex optimization as follows. For ( 13.91 ). using convex optimization 
we can minimize the term 

Tr(Wp s ) = A + Y^AiPi (3-10) 

where Aq would be chosen in a way that Tr(Wp s ) ^ 0. Although we apply this procedure for 
a pure state, but if the minimum of (I3.10p is positive with all pure states, it will be positive 
for mixed states because mixed states could be written as convex combination of pure states. 
To summarize, the convex optimization problem takes the form 

n 

minimize Aq + AiPi 

i 

subject to /(Pi,..,P n ) <0, (3.11) 

#i(Pi,..,P n ) ^ for z = l,...,m. 

where /(Pi, .., P n ) is nonlinear inequality constraint and (ft (Pi, .., P n ) are linear inequality con- 
straints. 

Example 3: Linear EWs for three qubits system 
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As a special case, in this section we obtain linear EWs for three qubits system with some 
details. From FR obtained in example 2, we minimize the function Yll=i AiP%- So our convex 
optimization problem takes form 

9 

Minimize f{P u P 9 ) = A i P i 

i=l 

9 

subject to 

i=\ 

±P 1 ± P 5 ^ 1, ±P l ± P 6 < 1, 
±P 2 ±P 4 ^1, ±P 2 ±P 6 ^1, 
±P 3 ±P 4 ^1, ±P 3 ±P 5 ^1. 
The Lagrangian for this problem is 

9 9 

L(P,A) = ^^P + A 1 (^P/-1) 

i=l j=l 

+A 2 (+Pi + P 5 - 1) + A 3 (+P - P 5 - 1) + A 4 (-P + P 5 - 1) + A 5 (-Pi - P 5 - 1) 

+A 6 (+Px + P 6 - 1) + A 7 (+P - P 6 - 1) + A 8 (-P + P 6 - 1) + A 9 (-P - P 6 - 1) 

+Ai (+P 2 + P 4 - 1) + A n (+P 2 - P 4 - 1) + A 12 (-P 2 + P 4 - 1) + A 13 (-P 2 - P 4 - 1) 

+Ai 4 (+P 2 + P 6 - 1) + A 15 (+P 2 - P 6 - 1) + A 16 (-P 2 + P 6 - 1) + A 17 (-P 2 - P 6 - 1) 

+A 18 (+P 3 + P 4 - 1) + A 19 (+P 3 - P 4 - 1) + A 20 (-P 3 + P 4 - 1) + A 21 (-P 3 - P 4 - 1) 

+A 22 (+P 3 + P 5 - 1) + A 23 (+P 3 - P 5 - 1) + A 24 (-P 3 + P 5 - 1) + A 25 (-P 5 - P 4 - 1) 

As noted in appendix A, any points that satisfy the KKT conditions are primal and dual 
optimal, and have zero duality gap so, we insist that points in FR must satisfy the KKT 
conditions which are 
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1. primal constraints: /j ^ , i=l,...,25 

2. dual constraints: Aj 0, z = 1, 25 

3. complementary slackness: Xifi{Pi, --^Pg) = ,i = 1, ...,25 

4. gradient of Lagrangian must vanish: VL(P, A, v) = 0. 

The first and second KKT conditions are satisfied automatically. For third constraints 
please note that duo to the convex optimization nature, the optimal point of the problem is in 
the intersection region of these constraints and, as this region also belong to the FR defined 
by only nonlinear constraint; therefore, we can consider the FR defined only by the nonlinear 
constraint and the role of other constraints are limiting this FR. Thus we can write the third 
condition of KKT in the following form 

A 1 >0^/ 1 (P 1 ,...,P 9 ) = (3.12) 

and 

A(Pi,...,P 9 ) <0^A i = 0, i = 2, ...,25. (3.13) 
Forth constraints of KKT conditions yields to 

P = -A , = !,..., 9 (3.14) 
substituting these equations in (I3.12p gives 

i=l 

and the minimum value of /(Pi, Pg) becomes 

-(X>n* ( 3 - 15 ) 

i=i 

Now the EW takes form 

9 

W = A III + J2^Qi (3-16) 

8=1 
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with following constraint 

i=l 

This constraint ensure that Tr(Wp s ) ^ 0. The other constraints on EW (13. 16[) which comes 
from f)2.8p . now takes form 
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where R = YLi A l 

For dual problem note that 



so the dual problem take form 



Maximize g(Ai) 
s.t. Ai > 
As Ai > 0, the maximum value of g(Ai) is 

-(£A 2 )i 



8=1 



(3.18) 



(3.19) 



(3.20) 



So the minimum of primal problem (I3.15p . is equal with the maximum of dual problem (13.201) . 
and there is no gap between them and the minimum of primal problem is global. 



non-linear entanglement witnesses 12 

4 Constructing nonlinear EWs via convex optimization 

As noted before, the envelope of family of linear EWs tangent to FR, could be considered 
as a nonlinear EW. We want to obtain this nonlinear EW via convex optimization. For this 
purpose we reformulate problem in convex optimization format. Suppose a density matrix, p, 
for a system is given. One can expand this density matrix in terms of related operators Qi in 
the Hilbert space of the system with coefficients say rj. 

P = Yl 

Entanglement detection condition requires Tr(Wp) ^ 0. Here W is the family of linear EWs, 
which have been obtained from previous section. We want to minimize Tr(Wp) and the convex 
optimization problem takes the form 

n 

minimize A r + A^i 

i=l 

subject to fi(A u ..,A n ) ^ 0, (4.21) 

where f(Ai, ..,A n ) is new inequality constraint which comes from previous section. 

So the nonlinear and linear EWs are constructed directly from convex optimization in 
two steps, as discussed above. This approach is completely general and could be applied for 
detection of entanglement of any quantum system. As a matter of fact, even for a system with 
complicating nonlinear and linear constraints and functions, this approach will lead to some 
nonlinear and linear EWs, this is because of the convexity nature of the problem, and if there 
is no analytical solution to the problem, one can solve problem by good numerical algorithms 
such as interior point method (which again is valid for KKT conditions) |17j . 

In the previous works of obtaining nonlinear EWs with convex optimization [251 [12] , there 
were two disadvantages. First, the linear inequality constraints are not considered, and second, 
the convex optimization for determining the nonlinear EWs, was not used explicitly in this 
form. 
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Example 4 : Nonlinear EW for three qubits system 

In this example as a special case, we construct nonlinear EW for a given density matrix of 
three qubit system in example 3. We choose EW in (13.161) . In this step the linear inequality 
constraints takes form (13.1 8p . The given density matrix for three qubits system could be 
written as follows 

3 

P = TiQi = ^ bij,k(7i ® CTj ® CTfc 

i i,j,k=0 

For better detection of entanglement of the system, we want to minimize Tr(W p) = Ylm=o r mA m 
therefore, convex optimization problem takes form 

9 

Minimize r m A m 



(4.22) 



m=0 
|2 



subject to - A 2 + R ^ 0, 
(A^Arf^R , (Ai - A 5 ) 2 < R 



(A 1 + A 6 ) 2 <: R 
(A 2 + A A ) 2 <: R 
(A 2 + A 6 ) 2 <: R 
(A 3 + A 4 ) 2 ^ R 
(A, + A,) 2 ^ R 



(A 1 - A 6 ) 2 <: R 
(A 2 - A A ) 2 *C R 
(A 2 - A & ) 2 <: R 
(A 3 - A,) 2 *C R 
(A 3 - A,) 2 <: R 



i=l 



The linear and nonlinear inequality constraints comes from (I3.17|) and (I3.18p . The Lagrangian 
for this part of problem is 

9 9 

L(A, n) = A r + A i r i + A l - A o) + M A i + A ^f ~ R ) + Ms((^i - A 5 ) 2 - R) 

i=i 

+// 4 ((A a + A 6 ) 2 -R) + ^{{A x - A 6 ) 2 - R) 
+» 6 ((A 2 + A A ) 2 -R)+ n 7 ({A 2 - A,) 2 - R) 
+MA 2 + A 6 ) 2 -R) + fi 9 ((A 2 - A 6 ) 2 - R) 
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+//io((A 3 + A A ) 2 -R) + u, n ((A 3 - A A ) 2 - R) 

+fi 12 ((A 3 + A 5 ) 2 -R) + fi l3 ((A 3 - A 5 ) 2 - R) 

The arguments for KKT conditions in example 3 are also valid here. From complementary 
slackness of KKT conditions we have 

9 



l > ^ MPr, ...,P 9 ) = Y,A 2 - A 2 = 



i=i 



and 

f i (P 1 ,...,P 9 ) < 0=^ = 0, /i = 2,. ..,13 
and zero gradient of Lagrangian condition yields to 

A- 

So the condition (I4.23P becomes 
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the other constraints (I4.24p . becomes 
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where 



T=—Tr 2 

An 

t=l 



(4.23) 



(4.24) 



(4.25) 



(4.26) 
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Thus the nonlinear EW detection becomes 

9 

Min Tr(Wp) = A [r - rf )*] (4.27) 
with constraints ( 14.260 . For dual problem we have 



9 

2\ 



g(Hi) = A r - (/i! + ^— Vr ; 
so the dual problem take form 

Maximize g(/ii) 

s.t. /ii > (4.28) 
As \i\ > 0, the maximum value of g(fii) is 

9 

4>[r -£>?)*]. ( 4 - 29 ) 

Again, the minimum of primal problem (I4.27p . is equal with the maximum of dual problem 
( I4.29p . and there is no gap between them and the minimum of primal problem is global. 

5 EWs for three qubits systems 

There are many special sets of linear and nonlinear EWs for three qubits with specific FRs. 
In this section we recover some of them for three qubits systems. These are classified into 
four sets and finding these FRs and linear and nonlinear EWs are completely similar to the 
previous sections. In the following we report FRs and EWs concisely. 

5.1 EWs with polygonal FR 

The polygonal FR in example 1, leads to polygonal class for three qubits linear EWs. The 
convex optimization for this problem is 

3 

minimize Aq + AiPi 
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subject to equation ( 12.4ft 



(5.30) 



and the relative EWs takes form 



W. 



a iii+ 



A[(-if Qi + (-if q 2 + (-if q 3 + (-i) l4 g 4 + (-if q 5 + (-i) ll+l2+l3+M+l5+1 g 6 ] (5.3i) 



where ii,...,i 5 = 0,1 then we have 32 linear EWs. Besides these EWs, we can construct 
other EWs by using the fact that local unitary operators take an EW to another EW. The 
36 transformation of table ([1]) on (15. 31 j) . give a new EW which could be constructed by local 
unitary operators. Please note that M^ y , means transformation which interchange x and y 
in the second qubit and so on. For example in ( 15.311) for i\ = ... = i$ — if we apply the 
transformation y MfL_ then 



which is a new linear EW. Therefore the total linear EWs, with odd number minus signs and 
all transformations of table 1, becomes 32 x 36 = 1184. 

These linear EW are non-decomposable because they can detect density matrices with 
positive partial transpose (PPT). For example the linear EW 



which comes from applying transformation My^ z M^ y M^ on (I5.3ip and taking A = A\ = 
1, i\ = ... = i§ = 0; can detect the PPT density matrix in [25]. As the non-decomposability 
of EWs are invariant under the transformations of table 1, therefore all 1184 linear EWs in 
this section are also non-decomposable. 



0,0,0,0,0 



AqIII + Ai{XXX + XZY + ZXZ + ZYY + YZZ - YYX] 



W = 111 + XXX + XYZ + YYY + YZX + ZXY - ZZZ 



5.2 EWs with conical FR 



Let us consider the following operators 



Z(XX + YY), Q\° = X(XX + YY), Q%° = Y(XX + YY), 
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Table 1: 36 transformation on (|5.3ip . 
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Q%° = Z{XY -YX), Q%° = X{XY -YX), Q%° = Y{XY - YX), 

Qf 3 ° = IZZ. (5.32) 

where the superscript Co in Q^s, shows the conical case. Now we try to determine the exact 
shape of the FR. The FR is a cone given by 



^J?-(1±P 13 ) 2 ^0 



(5.33) 



(for a proof, see appendix B). First convex optimization gives two related EWs as follows 

6 



(5.34) 



minimize Ai 3 P 13 + AjP, 

i=i 

subject to (15.331) 
The minimum is equal to — v4 13 , provided that 

4 = E^ ( 5 - 35 ) 

1=1 

and the constraints Tr(W / p sep ) ^ leads to A ^ Ai 3 . So the linear witnesses becomes 

6 

W Co = A (III ±Q 13 + J2 A iQi) ( 5 - 36 ) 



1=1 



Second convex optimization gives the nonlinear EW as follows. The minimum of Tr(Wp) 
subject to constraints A — A i3 ^ and (I5.35j) becomes 



Min Tr{Wp) = A (l ±r 



13 



r\ + ... + r\ 
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Further, if we consider other operators such as 

QC° = Z(XX -YY), Q%° = X{XX -YY), Q$° = Y{XX -YY), 

Qg° = Z(XY + YX), Qg° = X{XY + YX), Qg° = Y(XY + YX), 
then one can show that 

p2 i p2 _ n2 , p 2 

1 4 7 -"10 

p2 , p2 _ P 2 , p2 

2 ' 5 8 J ll 

P 2 + P 6 2 = P 2 + P 2 2 (5.37) 

One can get new EWs, under any replacement of one or more left hand sides of ( 15.371) with 
their respective right hand sides in the (15.331) . As this can be done in eight ways, number of 
EWs so far are 2 x 8 = 16. In addition, the replacement of first party with second or third 
also give new EWs and as a result, the number of EWs in this form become 16 x 3 = 48. 
Again similar to the previous subsection arguments, these EWs are non-decomposable. 

5.3 EWs with spherical FR 

For some special choice of operators one can get FR with hyper spherical shape. Some set of 
these choices is for following operators. 

Q x = Z{XX + YY), Q 2 =X{XX + YY), Q 3 = Y(XX + YY), 

Q i = Z(XY -YX), Q 5 = X{XY-YX), Q 6 = Y(XY -YX), 
Q 7 = Z(XX - YY), Q 8 = X(XX -YY), Q 9 = Y(XX -YY), 
Q 10 = Z(XY + YX), Q n = X{XY + YX), Q 12 — Y(XY + YX), 

Q 13 = IXZ, Q 14 = IYZ, Q 15 = IZI. (5.38) 

and the FR becomes 

Pi + ... + P 6 2 + P 2 3 + Pi + P 2 5 ^ 1 (5.39) 
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The proof is similar to the previous proofs in the appendix B. The relative EWs become 

6 

W = A III + A l3 Q 13 + A lA Q lA + A 15 Q 15 + A iQi ( 5 - 40 ) 

i=l 

with constraint Aq ^ +^13 + A 2 4 + Af 5 + Yli=i A 2 - Finding the nonlinear EWs is completely 
similar to example 4. 

We can find 14 other FRs with the following replacements 

I — > {ji\X + n 2 Y + n 3 Z), n\ + n\ + n 2 = 1 

in any parties of Q13, Q14 or Qi 5 in ( 15.381) . For example if we replace Q13 = IX Z with 
Qw + Q17 + Qis = XX Z + YXZ + ZXZ, then the new FR becomes 

Pi + ... + Pi + P 2 l4 + P? 5 + P 2 m + Pi + Pi ^ 1 (5.41) 

Now the convex optimization problem is Min ~Y%=\A%P% + Sj=i4 A/-^?' s -^- (15.41 D . and the 
linear EWs become 

6 18 

W = A III + A iQi + ( 5 - 42 ) 

i=l j=14 

with constraint A ^ Ei=i A 2 + X^j=i4 A?] 1 / 2 . Again this constraint comes from the condition 
Tr(Wp sep ) ^ 0. In each of these 1 + 14 = 15 FRs if we replace one or more of left hand sides 
of the following equations with the respective right hand sides, we will get new FRs. 



1 ' 4 7 r i 



10 



p2 1 p2 _ p2 1 p2 
2 "r" 5 8 - r ll 



P 2 + P 2 6 =P 2 + Pl 



As there are 7 possible replacements with one on replacement, we have 8 x 15 = 120 spherical 
FR up to now. In addition, the replacement of first operator with second or third in all terms 
of ( 15.381 ) also give new FR and as a result, we have 120 x 3 = 360 spherical FR. Finally 
learning from previous proofs in appendix B, we present another spherical FR which is 

27 
i=l 
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Therefore the total EWs for this set becomes 361 which are non-decomposable (similar to the 
previous subsections arguments). 

5.4 EWs with other FRs 

There are many FRs for three qubits which lead to relative EWs. Here we obtain two cases as 
follows. 

A. First case 

Consider the following set of operators 

Q l = XZZ, Q 2 = XXX, Q 3 = ZXZ, Q 4 = ZZX, 

Q 5 = -ZXI, Q 6 = -ZZI, Q 7 = XZI, Q g = XXI, 

Q 9 = -IZX, Q w = -IZZ, Q u = IXZ, Q 12 = IXX, 

Q ia = -XI Z, Q 14 = -ZIZ, Q 15 = ZIX, Q 16 = XIX. (5.43) 

With this choice, we have the following nonlinear constraints ( the proof is similar to the 
previous proofs in appendix B, therefore is omitted ). 

(P 1 +P 2 ) 2 + (P 3 + J P 4 ) 2 ^1 

Pi + Pi + P 7 2 + Pi ^ 1 
Pl + P? + P? 1 + P? 2 ^l 

P 2 n + Pi, + Pi + Pi ^ 1 (5.44) 

The related EW is W = A + X^=i AiQi- As discussed before, using convex optimization 
method we see that this EW candid satisfy Tr(Wp s ) > condition if 



Ao -(yjA* + Al + yjAl + A* + A* + Aj+ 
sjll + Aj + A\ x + A\ 2 + JaJ 3 + A\, + A\, + A* 6 ) > (5.45) 
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For obtaining nonlinear form now the inequality constraints have same form as in (15.441) but 
we must replace Pi to A iy so the convex optimization problem takes form 



16 



Minimize Tr(Wp) = A r + ^ A 



3 T 3 



subject to condition 



(A 1+ Aj + {A, + A,f ^1 
A\ + A\ + A 2 7 + Al ^ 1 

^9 + ^10 + ^11 + ^12 ^ 1 

Aj 3 + A\ A + A 2 5 + A\ < 1 (5.46) 
Again using convex optimization method, the result is 



Tr(VTp) = A [(r - ( v 7 ^! + r 2 ) 2 + (r 3 + r 4 ) 2 + ^/rf + r| + rf + r| 



+ \/ r 9 + r ?o + r n + r ?2 + V r ?3 + r? 4 + rj 5 + ii 6 )] (5-47) 

B. Second case 

Here, we consider the following Hermitian operators 

Q 1 = XXX, Q 2 = YXX, Q 3 = ZXX, Q A = XYY, 

Q 5 = YYY, Q 6 = ZYY, Q 7 = XZZ, Q 8 = YZZ, Q 9 = ZZZ (5.48) 
The FR takes form 



pl + pf + pf + yjpi 2 + p 2 + p 2 + \jpi + Pi + Pi ^ i. (5.49) 

Using convex optimization method for satisfying the condition Tr{Wp) ^ we have A — 
yj A\ + A\ + A\ ^ with conditions A\ + A\ + A\ = A\ + A\ + A\ = A 2 7 + A\ + A 2 ,. 
The nonlinear EW takes form 

Tr(Wp) = A [1- (r? + r 2 2 + r 2 ) 1 / 2 + ( r 2 + r 5 2 + r 2 ) 1 / 2 + (r 2 + r 8 2 + r 2 ) 1 / 2 ] (5.50) 
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6 Optimality of the EWs 

In general, we have not found a proof for optimality of nonlinear EWs although, we expect 
that optimality problem could be solved using convex optimization and this issue is currently 
under investigation. However, in this section we consider optimality proofs for linear EWs 
with polygonal FR, and a special case of spherical EWs. 

To do so let us recall that if there exist e > and a positive operator V such that W = 
W — eV be again an EW, the EW W is not optimal, otherwise it is. Every positive operator 
can be expressed as a sum of pure projection operators with positive coefficients, i.e., V = 
J2i Kltfi) itfil with all X i > 0, so we can take V as pure projection operator V = \ip)(ip\. If W 
is to be an EW, then must be orthogonal to all pure product states that the expectation 
value of W over them is zero. The eigenstates of each three-qubit Pauli group operator can be 
chosen as pure product states, half with eigenvalue +1 and the other half with eigenvalue -1. 
In EWs introduced so far, there exists no pair of locally commuting Pauli group operators, so 
the expectation value of such pauli group operators vanishes over the pure product eigenstates 
of one of them. 

6.1 Optimality of the EWs with polygonal FR 

Let us begin with the following EWs with polygonal FR 

W =A III+ 

A 1 [(-l) n ZZZ+(-l) I2 XXX+(-l) ,3 XZr+(-l) I4 FXZ+(-l) l5 FFF+(-l) !1+l2+I3+H+,5+1 ZFX]. 

(6.51) 

This EW comes from with transformation My^ z on the ( 15. 31 1 ) and rearranging terms. We 
discuss two cases i 1 — and i 1 — 1 separately. For the case i 1 = 0, note that we can take the 
pure product states 

\z;+)\z;+)\z;+), \ Z ;+)\z;-)\z',-), \z; -)\z; -), \z; -}\z; -}\z; +} , (6.52) 
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as eigenstates of the operator o z o z o z with eigenvalue +1 and the following ones 

\z;+)\z;+)\z;-), \z; +)\z; -)\z; +), \z; -)\z; +)\z; +), \z; -)\z; -)\z; -). (6.53) 



as eigenstates with eigenvalue -1. The EWs Wo t i ,i 3 ,i 4 ,i B have zero expectation values over the 
states of (I6.53p . so if there exists a pure projection operator \ip)(ip\ that can be subtracted 
from EWs Wqj i i i , the state ought to be of the form 



W) =a +++ \z;+)\z;+)\z;+) + a + __\z;+)\z;-)\z;-) 

(o.54) 

+a_ + _\z; -}\z; +}\z; -) + a__ + \z; -}\z; -)\z\ +). 

Expectation values of Wo,o,i 3 ,i 4 ,i 5 over pure product eigenstates of the operator o x a x a x with 
eigenvalue -1 are zero, so \ip) should be orthogonal to these eigenstates. Applying the orthog- 
onality constraints gives the following equations 

(x; +\(x; +\(x; -\\ip) = ~ a + __ ~ a_ + _ + a__ + ) = 0, 

(x; +\(x; -\(x; +\\ip) = ^(a +++ - a + _„ + a_ + _ - a__ + ) = 0, 
(x; -\(x; +\(x; +\\ip) = ^(a +++ + a + __ - a_ + _ - a__ + ) = 0, 
(x; -\(x; -\(x; -\\if>) = ^K ++ + a + __ + a_ + _ + a__ + ) = 0. 

The solution of this system of four linear equations is = a + = a_ + _ = a + = 0. Thus 

l^) = 0, that is, there exists no pure projection operator \ip){ip\, hence no positive operator V, 
which can be subtracted from Wop^^,^ and leave them EWs again. So the EWs W^co,^,^,^ 



are optimal. Similar argument proves the optimality of EWs Wo,i,i ,i 4 ,t • 



As for EWs Wi s i 2t i i 4s i , the state \ip) (if exises) ought to be of the form 
W) = a ++ _\z; +)\z; +)\z; -) + a + _ + \z; +)\z; -)\z; +) 

(o.55) 

+a_ ++ \z; -)\z; +)\z; +) + a___\z; -)\z; -)\z; -). 

The same argument as above shows the impossibility of existing such Therefore, the EWs 
W^i,^ ,i 3! i 4 ,i 5 are also optimal. 
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6.2 Optimality of a special case of spherical EWs 

For some special cases of EWs with spherical FR one can show the optimality of EWs. For 
example, consider the following case which is the spherical case in [25] . 
One of these spherical EWs is 

W = 111+ 1 — [AyZII + A 2 (XXX + XYY) + A 3 (YXY + YYX)] (6.56) 

yjA\ + A\ + A\ 

Let us first find pure product states that the expectation value of (I6.56P over them vanishes. 
For this purpose, we consider a pure product state as follows 

k) = (g) (cos(|)|z;+) +exp(^.)sin(|)|^-) N ) (6.57) 

3=1 V J 

and attempt to choose parameters 6 and (p. such that Tr{W\v)(v\) = 0. By direct calculation, 
this trace is 



Tr(W\u)(u\) = 1 + * cobO, + sinfl, sm9 2 sin# 3 



In this relation, if we choose = cp, = 5, cos?/', = — p==, and sin?/'. = , ^ 3 = then ( 16.581) 
will become 

Tr{W\u)(v\) = 1 + -f=0— cosO, + sine, sm9 2 si ng 3 ^=A_ CO s(^ - ^) (6.59) 



In (J63HD, if we choose ^ = ^, # 2 = 9 3 = f , cos^ 2 = -^=jk_ , and sin^ = -^SS= 
then (16.601) will become 

Tr(W|i/)(i/|) = l + cos(^ 2 -0J. (6.60) 

and the choices of parameters ip 2 — 9 1 = n, lead to zero value for the Tr{W\v)(v\) = 0. 

Now similar to the above discussion, it is easy to see that the following eight choices of 
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parameters 6 j and <p. lead to zero value for the Tr{W\v){y\) : 

W2) ■ e 2= e 3 = l, ^2- e i=K, ¥> X =-V'l, ^2=^3 = 

h) : ^2=^ = f ; ^2+^1=^. <Pl=A, ^2 = 1, ^3 = 

K) : ^2 = #3 = f > 1p2+8l= 7T, ¥>1 = ¥?2 = T' ^3 

ks) : ^2=^3 = f> ^2-^l =7r > <Pl=l/>l, <P2 = T> V 3 = 

We) : d 2 = 83 = f ) ^ 2 - 0i = 7T, ^ = ^ 2 = ^, ¥? 3 

02=03 = f 5 ^2+0i =7r > V>1 =< *I>1, ¥2 = ~T> ^3 
k 8 ) : ^2 = ^3 = f » ^2 + 01 = ^*) ^1 = -A, ¥2 = "I , <^3 

For (16.561) . the state |^) (if exists) must be of the following form 

\ip) = a+++\z; +)\z; +)\z; +) + a ++ _\z; +)\z; +)\z; -) 
+a + _ + \z; +)\z; -)\z; +) + a + __\z; +)\z; -)\z\ -) 
+a_ ++ \z; -}\z; +}\z; +) + a_ + _\z; -}\z; +}\z; -) 
+a__ + \z] -)\z; -)\z; +) + a___\z; -)\z; -)\z; -). 
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and be orthogonal to the above eight states, i.e., 

(z/J^) = [sin^(a +++ +a ++ _e l ? + a + _ + e J ? +a + __e*^) 
-e^ 1 cos + a_ + _e*5 + a__ + e*5 + a___e*f)] = 0, 

(z/J^) = [ sin ^( a +++ +a ++ _e t_ ^ +a + _ + e i ^ 1 + a + __e 1- ^) 
-e^ 1 cos ^(a_ ++ + a_ + _e i= r + a__ + e i= f + a___e*"?)] = 0, 

(v 3 \*l)) = [sin^(a +++ — a ++ _e 1 ^ + a + _ + e J ? — a + e 1 ^) 

_l_ e #i cos ^(a_ ++ — a_ + _e l ? + a__ + e l ? — a e 2 ^)] = 0, 

(vjV) = [sin^(a +++ +a ++ _e ! T - a + _ + e ! T -a + __e~*5) 
+e -#i cos ^(a_ ++ + a_ + _e*T - a__ + e i= r - a___e-*f )] = 0, 
(vjV) = [sin^(a +++ - a ++ _e*5 - a + _ + e*^ +a + __e*^) 
cos fK-a_ ++ + a_+_e i 5 + a__ + e*i - a___e i l)] = 0, 
(f 6 |V) = [sin^(a +++ — a ++ _e i ^ L — a + _ + e 1 ^ +a + __e 1 ^) 
+e _< ^ cos ^(-a„ ++ + a_ + _e i= r + a__ + e _i 5 - a___e^)] = 0, 
(v 7 |-0) = [sin^(a +++ +a ++ _e^ — a + _ + e*^ — a + __e 4 i) 

+e #i cos ^(a_ ++ + a_ + _e i f - a__ + e^ - a e*f )] = 0, 

(z/ g |^) = [sin ^(a +++ — a ++ _e~*i + a + _ + e~ l 5 — a + __e~*^) 
+e -#i cos ^(a_ ++ - a_ + _e _i * + a__ + e~^ - a___e~%\ = 0, 

The above system of eight equations has trivial solution a +++ = a ++ _ = a + _ + = a + = 

a_ ++ = a_ + _ = a + = a = provided that ipi ^ 0, ±|, ±n and ?/> 2 7^ 0, ±7r. This proves 

the optimality of (16.561) for all but = 0, ±|, ±7r and ^ 2 = 0, ±n values of ip. 

7 Detection of entanglement for three qubits systems 

In this section we develop two applications for EWs obtained via convex optimization method. 
Firstly, a density matrix is given and we want to construct some EWs for determining en- 
tanglement of this density matrix, and secondly a general class of nonlinear EWs is known 
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and we would like to find some density matrices which could be detected efficiently by this 
class of nonlinear EWs. First application is completely natural and some straightforward. But 
second is not so trivial and an important question is: what is the physical motivation for this 
constructed density matrix? Some motivation are as follows. As any density matrix shows a 
real physical system, the entanglement source and channels may be rearrange in a way that 
the final density matrix for system be equal approximately to the constructed density matrix. 
Although this is a hard task, but if the constructed density matrix is valuable from experi- 
mental point of view, maybe this procedure will become a way for entanglement detection. 
On the other hand, at least as a toy model, this method will give some intuition to physical 
system. Although we are not deal to these subjects, we will discuss about how to construct 
some density matrices by this method. 

7.1 Detection of density matrices 

We begin with some known density matrices for three qubits systems and try to detect entan- 
glement of them with nonlinear EW constructed by exact convex optimization in the following 
three examples. 

A. Unextendible product bases density matrix 

The density matrix considered here, is the entangled state in [26J which is constructed using 
unextendible product bases (UPBs), and has the very interesting property of being separable 
for every possible bipartition of the three parties. The state has the following expression: 




(7.62) 



i=i 



where 



o,i,+),^ 2 = |i,+,o), 



V>3 



+ ,0,1), ^4 
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and |±) = (|0) ± \ l))/y/2. Rewriting (17.621) in terms of Pauli operators yields 
p = -[III + -{-I XX - IX Z + IZX + IZZ - XIX + XI Z 

- XXI + XXX - XZI + XZZ - ZIX + ZIZ + ZXI + ZXZ + ZZI + ZZX)] (7.63) 

Now one can choose operators sets Qi from f 1 7 . 6 3 1) in a way that the related EW can detect 

entanglement of the system. One of these sets are (I5.43P which leads to the nonlinear EW 

(I5.47p . The detection of this nonlinear EW (15.471) for UPB density matrix (17. 63ft is Tr(W p) = 
-1-V2 

16 • 

B. W state density matrices 

The second mixed state density matrix which we consider here is W state density matrix 
[27] . Consider the state 

p= l -{l-p)III + p\W)(W\ 

where \W) = 1 100) + 1 010) + |001) is the three partite W state. In [27], using an entanglement 
witness operator, the range for the parameter p, in which their EW detects p, i.e., Tr(Wp) < 0, 
is found to be 3/5 < p ^ 1. 

Using our nonlinear EW (I5.50p . the entanglement detection range for parameter p, is 
3/7 < p ^ 1 which shows better detection (range of p is wider than before). 

C. Mixed GHZ with W states density matrices 

As the final example consider the following mixed GHZ with W states density matrix 

p = JiviXVii + Idw^mi + \w 2 )(w 2 \) 

where |V>i) = 75GOOO) ± 1 1 11>) is GHZ state for three-qubits and |Wi) = ^(|001) + |010) + 
|100)), \W 2 ) = ^(|110) + |101) + |011)) are W states for three-qubits. The nonlinear EW (JS3ZD, 
can detect the entanglement of this density matrix and the detection is Tr(Wp) = — J}- 
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7.2 Miscellaneous three-qubits PPT density matrices 

Here we construct some three-qubits PPT density matrices by nonlinear EWs. As an example 
consider the following nonlinear EW. 

3 12 

W = A (III ± Qg° + A *Q?° + E A ^°) ( 7 - 64 ) 

i=l j=10 

Now we choose some Pauli operators from this nonlinear EW and introduce a density matrix 
in the following form 

p = \[1 1 1 + rJZZ + r 2 (ZXX + ZYY) + r 3 (XXX + XYY) + r 4 (FXX + YYY) 
8 

+ r 5 (ZXF + ZYX) + r 6 (II7 + XFX) + r 7 (YXY + FFX)] (7.65) 
The PPT conditions for this density matrix are 

(1 ±n ±2y^ ) > 0, (7.66) 

(l±ri ±2y^R| ) ^ 0. (7.67) 
where i?^ = r| + rf + r| and = rf + rf + rf . The solution for these PPT conditions are 

ri = 1, i?! = 0, i? 2 = (7.68) 

n = -1, i?i = 0, i? 2 = (7.69) 

-i<n<0, -(i + n)^2i2 1 <(i + n), -(l + n) < 2^ < (l + n) (7.70) 
0<n<i, -(i-n)<2i2i^(i-ri), -(l - n) < 2i?2 ^ (l - n) (7.71) 

so the detection conditions become 



Tr{Wp) = 1 + n - 2^i2? + i?i < 0, 
Tr(Wp) = 1 - n - 2^R\ + R 2 2 < 0. 
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Therefore we construct a three qubits PPT density matrix by a nonlinear EW and the entan- 
glement of the density matrix is detected by this nonlinear EW. 
As another example, consider following density matrix 

p = - [III+r 1 XXX+r2YXX+r 3 ZXX+nXYY+r 5 YYY+r 6 ZYY+r 7 XZZ+r 8 YZZ+r 9 ZZZ} 
8 

(7.72) 

The PPT conditions for this density matrix are 

-(1 ± + r 4 - r 7 ) 2 + (r 2 + r 5 - r 8 ) 2 + (r 3 + r 6 - r 9 ) 2 ) ^ (7.73) 
o 

-(1 ± y/fa - r 4 + r 7 ) 2 + (r 2 - r 5 + r 8 ) 2 + (r 3 - r 6 + r 9 ) 2 ) ^ (7.74) 
o 

-(1 ± VC-n + r 4 + r 7 ) 2 + (-r 2 + r 5 + r 8 ) 2 + (-r 3 + r 6 + r 9 ) 2 ) ^ (7.75) 
o 

^(1 ± y/(n + r 4 + r 7 ) 2 + (r 2 + r 5 + r 8 ) 2 + (r 3 + r 6 + r 9 ) 2 ) ^ (7.76) 
o 

For this case, the non-linear EW, ( 15.5011 . detects (17.721) with following conditions. In the PPT 
conditions if we choose ^ for Vi and also the final PPT condition (I7.76P is satisfied, then 
all other PPT conditions would be satisfied. In addition, the following three inequalities must 
be satisfied (for detection) 

[(r\ + r 2 + r 2 )(r 2 + r\ + r 2 )] 1/2 ^ (nr 4 + r 2 r 5 + r 3 r 6 ), 

[(r 2 + r 2 + r 2 )(r 2 + r§ + r 2 )] 1/2 ^ (nr 7 + r 2 r 8 + r 3 r 9 ), 

[(f"4 + r 5 + r e)( r 7 + r 8 + r g)] 1/2 ^ ( r 5 r 7 + r 5 r 8 + r 6 r 9 ). 
which come from applying the Cauchy-Schwartz inequality to each part. 



8 Conclusion 



We have presented a general algorithm via exact convex optimization to the problem of finding 
nonlinear and linear EWs. This approach is completely general and could be applied for 
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detection of entanglement of any N-partite quantum system. For this purpose we defined a 
map from convex space of separable density matrices to a convex region called FR so the 
problem of finding EWs was reduced to the convex optimization problem which could be 
solved by the Karush-Kuhn- Tucker convex optimization method. The problem of finding FRs 
is occupy a significant place in our algorithm and the main finding of the study for three-qubits 
reveal how systematic such convex optimization algorithm can be. As exemplified by our three- 
qubits study, there are many FRs for a quantum system which lead to linear and nonlinear 
EWs and this is a good reason to think that finding the whole FRs is time-consuming and our 
expectation is that finding the whole FR is a nontrivial algebraic geometry problem. While our 
analysis is for three-qubits systems, it serves to provide a unified explanation for a variety of 
EWs with striking detection ability with respect to previous EWs. The main conclusion is that 
the presented algorithm provide indispensable prerequisites for further investigation and can 
bring a robustness in constructing EWs for a system. Application of this algorithm to other 
quantum system and finding related FR is still an open problem which is under investigation. 
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Appendix A 

Convex optimization review 

An optimization problem [17], has the standard form 
minimize /o (x) 

subject to fi(x) ^ 0, i — 1, m. 
hi(x) = 0, i = 1, ...,p. 

Where the vector x = (xi,...,x n ) is the optimization variable of the problem, the function 
fo '■ R n — > R is the objective function, the functions fi : R ra — > R, i = 1, ...,m, are the 
(inequality) constraint functions, and the constants bi, b m are the limits, or bounds, for the 
constraints. A convex optimization problem, is an optimization problem where the objective 
and the constraint functions are convex functions which means they satisfy inequality fi(ax + 
(3y) ^ ozfi(x) + Pfi(y), for all x,y G R and all a, (3 G R with a + j3 = 1, a^O, [3^0 and 
the equality constraint functions hi(x) = must be affine (A set C G R n is affine if the line 
through any two distinct points in C lies in C). 

One can solve this convex optimization problem using Lagrangian duality. The basic idea in 
the Lagrangian duality is to take the constraints in convex optimization problem into account 
by augmenting the objective function with a weighted sum of the constraint functions. The 
Lagrangian L : R n x R m x R p — > R associated with the problem is defined as 

m p 

L(X, A, V) = f (x) + ^ ^ifi( X ) + 5^ U i h i( X ) ( A "i) 
i=l i=l 

The Lagrange dual function g : R m x R n x R m x R p —>■ R is defined as the minimum value of 
the Lagrangian over x: for A G R m , v G R p , 

g{\ v) = inf xeo L(x, A, v) (A-ii) 

The dual function yields lower bounds on the optimal value p* of the convex optimization 
problem, i.e for any A y and any v we have 

g{\v)^f (A-iii) 
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The optimal value of the Lagrange dual problem, which we denote d*, is, by definition, the 
best lower bound on d* that can be obtained from the Lagrange dual function. In particular, 
we have the simple but important inequality 

This property is called weak duality. If the equality d* = p* holds, i.e., the optimal duality 
gap is zero, then we say that strong duality holds. If strong duality holds and a dual optimal 
solution (A*, v*) exists, then any primal optimal point is also a minimizer of L(x, A*, v*). This 
fact sometimes allows us to compute a primal optimal solution from a dual optimal solution. 

For the best lower bound that can be obtained from the Lagrange dual function one can 
solve the following optimization problem 
maximize g(X,u) 
subject to A y 

This problem is called the Lagrange dual problem associated with the main problem. Condi- 
tions for the optimality of a convex problem is called Karush-Kuhn- Tucker (KKT) conditions. 
If fi are convex and hi are affine, and x, A, v are any points that satisfy the KKT conditions 
fi(x) < 0, i = l,...,m 
hi(x) = 0, % = 1, ...,p 
\ > 0, i — 1, m 
\fi(x) = 0, i = l,...,m 
V/o(x) + i AiV/i(x) + Ei=i Whi(x) = 

then x and (A, v) are primal and dual optimal, with zero duality gap. In other words, for 
any convex optimization problem with differentiable objective and constraint functions, any 
points that satisfy the KKT conditions are primal and dual optimal, and have zero duality 
gap. Hence, f (x) = g(\;u). 

The condition \fi{x) = 0, % — l,...,m is known as complementary slackness; it holds for 
any primal optimal x, and any dual optimal A, v (when strong duality holds) 
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Appendix B: Proving FR inequalities 

a). FR inequality (j2.4\) of example 1 

Here we prove inequality (12.41) for i\ = ... = = 0. The other cases could be proved 
similarly. We use the abbreviations 

Tr(af ] \a)(a\) = a % 

Tr{of \m\) = \ ( A4 ) 
Tr{af | 7 )(7l) = c r 

where the superscripts 1, 2, 3 in denotes the first, second, and third party respectively. Since 
a 2 + a 2 + a 2 = 1 and also the similar relations hold for 6/s and c/s, so the points a, b, c lie on 
a unit sphere and we can parameterize their coordinates by using spherical coordinates and 
if as follows 

a 1 = sin Q x cos (p 1 , a 2 — sin 8 1 sin ip 1 , a 3 = cos9 l 
6 1 = sin 6* 2 cos(p 2 , b 2 = sin0 2 sin<^ 2 , b 3 = cos9 2 
c x = sin 3 cos ip 3 , c 2 = sin 3 sin ip 3 , c 3 = cos 9 3 . 

Now 

Pi + P 2 + P 3 + ^4 + P 5 ~ P<> = 

[ai(6ici + 6 2 c 2 ) + a 2 (&ic 3 + b 3 c 2 ) + a 3 (6 2 c 3 - hd)] ^ [1 - (61 c 2 - 6 2 ci - & 3 c 3 ) 2 ] 

which is equal or less than one. In the last step we use the Cauchy-Schwartz inequality. 
b). FR inequality ft2.7\) of example 2 



From definition Pi = Tr(Qip s ) we have 

Pi = cos (0i ) sin(0 2 ) sin(0 3 ) cos(<^ 2 - (p 3 ), 
P 2 = cos(<^i) sin (0i ) sin(0 2 ) sin(0 3 ) cos(v? 2 - y? 3 ), 
P 3 = sin(v?i) sin(0i) sin(0 2 ) sin(0 3 ) cos(y2 2 - cp 3 ), 

P 4 = cos(0i) sin(0 2 ) sin(0 3 ) sin(y2 3 - ip 2 ), 

P 5 = cos(<£i) sin(0i) sin(0 2 ) sin(0 3 ) sin(y2 3 - <p 2 ), 
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P 6 = sin(y?i) sin(0i) sin(0 2 ) sin(0 3 ) sin(</9 3 - tp 2 ), 
P 7 = sin(0 2 ) cos(y? 2 ) cos(0 3 ), 
P 8 = sin(0 2 ) sin(v? 2 ) cos(0 3 ), 
P 9 cos(0 2 ). 

Now YlP? = sin 2 (0 2 ) sin 2 (0 3 ), and P 7 2 + P| = sin 2 (0 2 ) cos 2 (0 3 ) so Y.\Pf = sin 2 (0 2 ) and finally 
Yl\Pi — 1- This equation defines the surface of hyper-sphere. As we want to determine the 
region on and inside of this surface then we can write Y^i Pf ^ 1) which defines the hyper ball. 
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